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This  briefing  is  based  solely  on  the  number  of  appraisals  reported  to  the  SEI.  It  cannot  be  used  as  a  source  for  an  exact  indicator  of 
all  organizations  in  the  world  using  SEI  models  or  appraisal  methods  nor  can  it  be  used  for  certification  or  verification  purposes. 

The  SEI  does  not  certify  organizations.  The  SEI  only  licenses  SEI  partners  and  SEI  authorized  lead  assessors  to  conduct  appraisals. 
Neither  the  SEI  nor  any  other  organization  is  a  “certifying  authority”  of  the  results  from  an  appraisal.  Therefore  requests  to  the  SEI  to 
provide  information  to  be  used  for  this  purpose  can  not  be  fulfilled.  Information  provided  by  the  SEI,  such  as  this  briefing,  is  to 
demonstrate  use  of  its  products  and  services  only. 

Organizations  performing  source  selection  or  verification  should  consider  performing  an  evaluation  appraisal.  For  more  information  on 
appraisal  methods  and  for  a  directory  of  authorized  lead  appraisers  who  can  perform  them,  visit: 
http://www.sei.cmu.edu/managing/app.directory.html 
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Introduction  - 1 :  Purpose  and  Source 

Characterize  the  process  maturity  of  the  software 
community 

This  briefing  uses  information  from  appraisals  using  the 
SW-CMM  in: 

•  CMM®- Based  Appraisals  for  Internal  Process 
Improvement  (CBA  IPIs)  and 

•  Software  Process  Assessments  (SPAs)  and 

•  Standard  CMMI®  Appraisal  Method  for  Process 
Improvement  (SCAMPISM),  vl  .1 

Please  visit: 

http://www.sei.cmu.edu/sema/profile_about.html 

for  additional  information  or  to  answer  questions  you  may 
have  about  this  briefing 
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Introduction  -  2:  Briefing  Contents 

This  briefing  includes  three  primary  sections: 

1-  Current  Status 

-  Snapshot  of  the  software  community  based  on  the  most 
recent  appraisal,  since  2000,  of  reporting  organizations 

2.  Community  Trends 

-  Global  distribution  of  appraisals 

-  Growth  in  the  number  of  appraisals  performed 

-  Shifts  in  the  maturity  profile  over  time 

3.  Organizational  Trends 

-  Analysis  of  Key  Process  Area  (KPA)  satisfaction 

-  Time  to  move  up  in  maturity  based  on  change  in  maturity 
level  and  time  between  appraisals 
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Section  1 :  Current  Status 

Appraisals  conducted  from  2000  through  June  2004 
and  reported  to  the  SEI  by  July  2004 

*  1,543  organizations 

*  741  participating  companies 

*  7,848  projects 

*  59.2%  Non-USA  organizations 


Please  refer  to:  Terms  Used  in  this  Report  on  page  29 
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Maturity  Profile 

by  All  Reporting  Organizations 

100%  T 

90%  - 


80% 


Initial  Repeatable  Defined  Managed  Optimizing 


Based  on  most  recent  appraisal,  since  2000,  of  1,543  organizations  reporting  a  maturity  level  rating 
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Reporting  Organization  Categories 


%  of  Organizations 

Based  on  1,543  organizations  reporting  organization  categories 


90% 
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Maturity  Profile 

by  Reporting  Organization  Categories 
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9.7% 


57.6% 


Initial  Repeatable  Defined  Managed  Optimizing 

□  Commercial/ln-house  ■  DoD/Fed  Contractor  □  Military/Federal 

Based  on  most  recent  appraisal,  since  2000,  of  1,543  organizations  reporting  categories  and  a  maturity  level  rating 
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Organization  Type 


Based  on  Primary  Standard  Industrial  Classification  (SIC)  Code 


Retail  Trade 

Wholesale  Trade  0.8% 

0.6% 


Business  Services 
34.8% 


Engineering  &  Management 
Services 
10.8% 


Health  Services 
0.3% 

Amusement  &  Recreation 
Services 
0.2% 

Services,  Nec 
0.2% 


Transportation, 
Communication,  Electric,  Gas 
and  Sanitary  Services 
5.4% 


Public  Administration  (Including 
Defense) 


Finance,  Insurance  and  Real 
Estate 
13.3% 


Equipment 

5.9% 


Instruments  And  Related 
Products 
6.2% 


Industrial  Machinery 
Equipment 
4.5% 


Transportation  Equipment 
5.6% 


Furniture  And  Fixtures 
0.2% 

Food  And  Kindred  Products 
0.2% 

Primary  Metal  Industries 
0.3% 

Chemicals  And  Allied  Products 
0.3% 


Printing  And  Publishing 
0.5% 

.  Fabricated  Metal  Products 
eryAnd 


0.9% 


Based  on  646  organizations  reporting  SIC  code.  For  more  information  visit:  http://www.osha.gov/oshstats/sicser.html 
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Organization  Size 

Based  on  the  total  number  of  employees  within  the  area  of  the  organization  that  was  appraised 


501  to  1000 
4.8% 


1001  to  2000 
1 .7% 


2000+ 

1.1% 


25  or  fewer 
13.4% 


301  to  500 
7.8% 


201  to  300 
9.7% 


51  to  75 
13.2% 


76  to  100 
9.6% 


26  to  50 
17.1% 


Based  on  1,512  organizations  reporting  size  data 
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Maturity  Profile  by  Organization  Size 

Based  on  the  total  number  of  employees  within  the  area  of  the  organization  that  was  appraised 


100%  -| 


90% 

80% 


The  number  of  organizations  for  the  2000+  category  is  small  which 
inflates  the  maturity  level  bars.  Please  see  page  9  and  take  this  into 
account.  The  purpose  of  this  chart  is  to  indicate  that  all  size 
categories  contain  most,  if  not  all,  maturity  levels. 


□  Initial  □  Repeatable  □  Defined  □  Managed  ■  Optimizing 


Based  on  1,512  organizations  reporting  size  data  and  a  maturity  level  rating 
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USA  and  Non-USA 

Reporting  Organization  Categories 


DoD/Fed  Contractor 


Military/Federal 


3.8% 


□  USA 
■  Non-USA 
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Based  on  630  U.S.  organizations  and  913  Non-USA  organizations  reporting  organization  categories 
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Maturity  Profile  by  All  Reporting 
USA  and  Non-USA  Organizations 
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□  USA  ■  Non-USA 

Based  on  630  U.S.  organizations  and  913  Non-USA  organizations  reporting  categories  and  a  maturity  level  rating 
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Section  2:  Community  Trends 

CBA  IPIs  ,  SPAs  and  SCAMPI  vl.1  using  the  SW-CMM  conducted 
since  1987  through  June  2004  and  reported  to  the  SEI  by 
July  2004 

*  3,360  appraisals 

2,853  CBA  IPIs 
484  SPAs 
23  SCAMPIs 

*  2,561  organizations 

*  922  participating  companies 

*  630  reappraised  organizations 

*  14,126  projects 


Please  refer  to:  Terms  Used  in  this  Report  on  page  29 
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Countries  Where  Appraisals  have  been 
Performed  and  Reported  to  the  SEI 


Argentina 

Australia 

Austria 

Barbados 

■■■■■■ 

Belgium 

Brazil 

Canada 

Chile 

China 

Colombia 

Costa  Rica 

Cyprus 

Czech  Republic 

Denmark 

Egypt 

Finland 

France 

Germany 

Greece 

Hong  Kong 

Hungary 

India 

Ireland 

Israel 

Italy 

Japan 

Korea,  Republic  of 

Latvia 

Malaysia 

Mauritius 

Mexico 

Netherlands 

New  Zealand 

Norway 

Pakistan 

Peru 

Philippines 

Poland 

Portugal 

Puerto  Rico 

Russia 

Saudi  Arabia 

Singapore 

South  Africa  Spain 

Sweden 

Switzerland 

Taiwan 

Thailand 

Turkey 

Ukraine 

United  Arab  Emirates  United  Kingdom  United  States 

Uruguay 

Venezuela 

Viet  nam 

©  2004  by  Carnegie  Mellon  University 

August  2004 

Process  Maturity  Profile  - 

Page  15 

Carnegie  Mellon  University 

Software  Engineering  Institute 


Software  CMM  -  CBA  IPI,  SPA  and  SCAMPI  Appraisal  Results 


Number  of  Appraisals  and  Maturity  Levels 
Reported  to  the  SEI  by  Country 


Country 

Number  of 
Appraisals 

Maturity 
Level  1 
Reported 

Maturity 
Level  2 
Reported 

Maturity 
Level  3 
Reported 

Maturity 
Level  4 
Reported 

Maturity 
Level  5 
Reported 

Country 

Number  of 
Appraisals 

Maturity 
Level  1 
Reported 

Maturity 
Level  2 
Reported 

Maturity 
Level  3 
Reported 

Maturity 
Level  4 
Reported 

Maturity 
Level  5 
Reported 

Argentina 

10  or  fewer 

Mauritius 

10  or  few  er 

Australia 

35 

Yes 

Yes 

Yes 

No 

Yes 

Mexico 

23 

Yes 

Yes 

Yes 

Yes 

Yes 

Austria 

10  or  fewer 

Netherlands 

23 

Yes 

Yes 

Yes 

No 

Yes 

Barbados 

10  or  fewer 

New  Zealand 

10  or  fewer 

Belgium 

11 

Yes 

Yes 

Yes 

No 

No 

Norw  ay 

10  or  fewer 

Brazil 

26 

Yes 

Yes 

Yes 

Yes 

Yes 

Pakistan 

10  or  fewer 

Canada 

73 

Yes 

Yes 

Yes 

No 

Yes 

Peru 

10  or  fewer 

Chile 

15 

Yes 

Yes 

Yes 

No 

No 

Philippines 

10 

China 

182 

Yes 

Yes 

Yes 

Yes 

Yes 

Poland 

10  or  few  er 

Colombia 

10  or  fewer 

Portugal 

10  or  few  er 

Costa  Rica 

10  or  fewer 

Puerto  Rico 

10  or  few  er 

Cyprus 

10  or  fewer 

Russia 

10  or  few  er 

Czech  Republic 

10  or  fewer 

Saudi  Arabia 

10  or  few  er 

Denmark 

10  or  fewer 

Singapore 

22 

Yes 

Yes 

Yes 

No 

Yes 

Egypt 

10  or  fewer 

South  Africa 

10  or  few  er 

Finland 

10  or  fewer 

Spain 

18 

No 

Yes 

Yes 

No 

Yes 

France 

135 

Yes 

Yes 

Yes 

Yes 

Yes 

Sweden 

10  or  few  er 

Germany 

56 

Yes 

Yes 

Yes 

No 

No 

Sw  itzerland 

10  or  few  er 

Greece 

10  or  fewer 

Taiw  an 

10  or  few  er 

Hong  Kong 

10  or  fewer 

Thailand 

14 

Yes 

Yes 

Yes 

No 

No 

Hungary 

10  or  fewer 

Turkey 

10  or  few  er 

India 

359 

Yes 

Yes 

Yes 

Yes 

Yes 

Ukraine 

10  or  few  er 

Ireland 

11 

Yes 

Yes 

Yes 

No 

No 

United  Arab 
Emirates 

10  or  few  er 

Israel 

30 

Yes 

Yes 

Yes 

No 

No 

United  Kingdom 

135 

Yes 

Yes 

Yes 

No 

No 

Italy 

32 

Yes 

Yes 

Yes 

No 

Yes 

United  States 

1896 

Yes 

Yes 

Yes 

Yes 

Yes 

Japan 

131 

Yes 

Yes 

Yes 

Yes 

Yes 

Uruguay 

10  or  few  er 

Korea,  Republic  of 

64 

Yes 

Yes 

Yes 

Yes 

Yes 

Venezuela 

10  or  few  er 

Latvia 

10  or  fewer 

Vietnam 

10  or  few  er 

Malaysia 

10  or  fewer 

The  organization  maturity  profile,  page  8,  can  be  created  for  certain  countries  using  the  Interactive  Maturity  Profile  available 
in  the  Software  Engineering  Information  Repository  Web  site.  Please  visit:  http://seir.sei.cmu.edu.  If  you  are  not  already  a 
member  of  the  SEIR  web  site,  please  register  to  join.  Registration  and  use  of  the  site  are  free. 
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Number  of  SW-CMM  Appraisals  Reported  to 

the  SEI  by  Year 

600  T 


500 


■  First  Appraisal  □  Reappraisal 


Based  on  3,360  appraisals  conducted  through  June  2004  and  reported  to  the  SEI  by  July  2004* 
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Number  of  SW-CMM  Appraisals  Reported 
to  the  SEI  by  Organization  Categories  and 
Year 


□  Commercial/ln-house  □  DoD/Fed  Contractor  □  Military/Federal 

Based  on  3,358  appraisals  reporting  organization  categories 
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Trends  in  the  Community  Maturity  Profile 


100%  i 


90%  - 


80% 

70% 

60% 

50% 

40% 

30% 

20% 

10% 

0% 


Year 

Orgs 

□  1987-1991 

132 

■  1992-1996 

635 

□  1997-2001 

1,662 

□  2002 

1,998 

■  2003 

2,420 

□  2004 

2,561 

Initial  Repeatable  Defined  Managed  Optimizing 


Based  on  a  cumulative  view  of  the  most  recent  appraisals  of  organizations  up  through  the  year  indicated. 
This  accounts  for  the  difference  from  the  figures  on  page  6. 
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Section  3:  Organizational  Trends 

Appraisals  conducted  through  June  2004  and  reported  to  the 
SEI  by  July  2004 

•  1,748  Key  Process  Area  (KPA)  profiles 

-  satisfaction  of  KPAs  by  maturity  level  for  organizations 
appraised  at  levels  1  and  2 

*  630  reappraised  organizations 

-  accounting  for  1,439  appraisals 

-  although  some  organizations  conducted  multiple 
reappraisals,  only  the  first  and  latest  appraisals  were  used 
in  creating  the  charts  on  pages  23  &  24 


Please  refer  to:  Terms  Used  in  this  Report  on  page  29 
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Key  Process  Area  Profiles  - 1 
Organizations  Appraised  at  Level  1 


Repeatable 


Defined 


Managed 


Optimizing 


5 


— r — 

50% 


3 

3 

I 

D 


JJ 


60%  70%  80%  90%  100% 


%  of  Appraisals 


Based  on  571  CBA  IPI  and  SCAMPI  with  SW-CMM  appraisals  reporting  a  maturity  level  rating 
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Key  Process  Area  Profiles  -  2 
Organizations  Appraised  at  Level  2 


Defined 


OPF 


OPD 


ISM 


SPE 


Managed  Q™ 

SQM 

Optimizing  dp 

TCM 

PCM 
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20% 


30% 


40% 


50% 


60% 


70% 


80% 


90% 


100% 


%  of  Appraisals 


Based  on  1177  CBA  IPI  and  SCAMPI  With  SW-CMM  appraisals  reporting  a  maturity  level  rating 
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Maturity  Level  of 
First  and  Latest  Appraisal 

100%  T 


90% 


80% 


42.1% 


Initial 


Repeatable 


Defined 

□  First  □  Latest 


7.6%  8.1% 


Managed 


15.9% 


Optimizing 


Based  on  630  reappraised  organizations  using  their  first  and  latest  appraisal 
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Reappraisals 
Change  in  Maturity  Level 


Level  4  to  5 
7.0% 


Level  3  to  5 
5.6% 


Moved  Down 
2.7% 


Level  3  to  4 
2.5% 


Level  2  to  5 
2.1% 


Level  2  to  4 
3.2% 


Level  1  to  4 
1.9% 


Level  1  to  5 
0.8% 


No  Change 


12.1% 

Level  1  to  1 

5.6% 

Level  2  to  2 

4.4% 

Level  3  to  3 

1.1% 

Level  4  to  4 

0.5% 

Level  5  to  5 

0.5% 

Based  on  630  reappraised  organizations  using  their  first  and  latest  appraisal 
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Time  to  Move  Up 


Level  1  to  2  2  to  3  1  to  2  2  to  3  3  to  4  4  to  5  1  to  2  2  to  3  3  to  4  4  to  5 

Orgs  25  12  164  242  51  59  189  254  53  59 
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Summary  of  Current  Status 


Commercial  and  in-house  organizations  reporting  most 
appraisals 

Of  U.S.  organizations,  the  services  and  manufacturing 
industries  reported  most  appraisals 

Half  of  the  organizations  reporting  size  have  100  or  fewer 
software  personnel 

More  Non-USA  appraisals  reported  than  U.S.  in  this  5  year 
snapshot 
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Summary  of  Organizational  Trends  - 1 


Software  Quality  Assurance  is  the  least  frequently  satisfied 
level  2  KPA  among  organizations*  appraised  at  level  1 

Integrated  Software  Management  is  the  least  frequently  satisfied 
level  3  KPA  among  organizations*  appraised  at  level  2 

Higher  maturity  has  been  reached  among  those  organizations 
reporting  reappraisals 


*Adjusted  for  number  of  organizations  rating  the  KPA 
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Carnegie  Mellon  University 

Software  Engineering  Institute  Software  CMM  -  CBA  IPI,  SPA  and  SCAMPI  Appraisal  Results 

Summary  of  Organizational  Trends 

(continued)  -  2 

For  organizations  that  began  their  CMM-based  SPI  effort  in 
1992  or  later,  the  median  time  to  move  from: 

•  maturity  level  1  to  2  is  22  months 

•  maturity  level  2  to  3  is  19  months 

•  maturity  level  3  to  4  is  25  months 

•  maturity  level  4  to  5  is  13  months 


Note:  The  median  time  to  move  from  maturity  level  2  to  3  dropped  from  21  month  to  19  month 
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Terms  Used  in  this  Report 

Appraisal  -  The  appraisal  methods  used  in  this  report  are  the  Software  Process 

Assessment  (SPA),  CMM-Based  Appraisal  for  both  Internal 
Process  Improvement  (CBA  IPI)  and  Standard  CMMI®  Appraisal 
Method  for  Process  Improvement  (SCAMPI).  We  do  request  and 
receive  other  Software  CMM-based  appraisals  such  as  Software 
Capability  Evaluations  (SCE)  and  Interim  Profiles.  As  our  sampling 
size  of  these  other  methods  increase,  they  will  be  reported  here. 

Company  -  Parent  of  the  appraised  entity 

A  company  can  be  a  commercial  or  non-commercial  firm,  for-profit 
or  not  for-profit  business,  a  research  and  development  unit,  a  higher 
education  unit,  a  government  agency,  or  branch  of  service,  etc. 

Organization  -  a.k.a.  Appraised  entity 

The  organization  unit  to  which  the  appraisal  results  apply.  An 
appraised  entity  can  be  the  entire  company,  a  selected  business 
unit,  units  supporting  a  particular  product  line  or  service,  etc. 

Non-USA  -  Appraised  entity  whose  geographic  location  is  not  within  the  United 

States.  The  parent  of  the  appraised  entity  may  or  may  not  be  based 
within  the  United  States. 
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Report  your  Appraisal  Results  to  the  SEI 

The  briefing  is  only  possible  due  to  the  cooperation  of 
organizations  and  individuals  sending  in  their  appraisal 
results  to  the  SEI 

In  order  to  provide  this  information  and  service  in  the  future, 
it  will  depend  on  this  continued  cooperation 

Please  visit: 

http://www.sei.cmu.edu/sema/report.html 

for  forms,  information,  and  instructions  on  how  to  report 
appraisals  to  the  SEI 
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Contact  Information 

Please  visit: 

http://www.sei.cmu.edu/sema/profile_about.html 

and  review  the  information  provided  before  contacting: 

SEI  Customer  Relations  (412)  268-5800 

SEI  FAX  number  (41 2)  268-5758 

Internet  Address 
customer-relations@sei.cmu.edu 

Mailing  Address 
Customer  Relations 
Software  Engineering  Institute 
Carnegie  Mellon  University 
Pittsburgh,  PA  15213-3890 
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